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ABSTRACT 



This thesis analyzes the dynamic response of a third order regulator sys- 
tem. Particular emphasis is placed upon the loss of stability of the nominal 
equilibrium state. The system utilized in this research models the funda- 
mental turning dynamics of an autonomous vehicle. We make extensive use 
of bifurcation theory methods in analyzing the dynamics after initial loss 
of stability. The effective gain of the system is used as the main bifurcation 
parameter, since this is directly related to the gain margin for linear systems. 
It is shown that the nonlinear characteristics of the system may significantly 
affect the practical significance of its gain margin, as a measure of robustness 
to parameter variations, unmodeled dynamics, and external disturbances. 
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L INTRODUCTION 



A. PROBLEM STATEMENT 

It is well known that in linear dynamical systems one of the most popular 
ways of assessing the stability properties of the system is through its gain 
margin (Friedland, 1986). Roughly speaking, the gain margin designates the 
extent at which the effective gain of the system can be increased before loss of 
stability occurs. Therefore, it is widely used in linear control system design 
in order to quantify a measure of robustness of the system with regards to 
parameter variations, disturbances, and un modelled dynamics. 

In this work we examine the concept of gain margin in the light of nonlin- 
ear systems. We assume that the baseline linear system is an approximation 
to a nonlinear system. For demonstration purposes we employ a third order, 
single input single output system, with cubic nonlinearities. This system 
models the fundamental turning dynamics of a marine vehicle (Oral, 1993). 
Primary loss of stability is shown to occur in the form of generic bifurca- 
tions to periodic solutions (Guckenheimer & Holmes, 1983). We use center 
manifold reduction techniques and integral averaging in order to capture the 
stability properties of the resulting limit cycles (Chow &: Mallet-Paret, 1977). 
The main conclusion of this work is that the linear concept of a gain margin 
can be used as a reliable measure of stability only in the case of supercritical 
bifurcations to periodic solutions. In the case of subcritical bifurcations, a 
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modification is necessary which is based on the nonlinear characteristics of 
the system. We propose the use of a parameter which governs transitions 
from supercritical to subcritical bifurcations as a nonlinear gain margin of 
the system. Results based on numerical simulations support the analytical 
predictions of this work. 



B. MATHEMATICAL MODEL 



Consider the ideal 3rd-order regulator system shown in Figure 1, where 
y is the actual output, y n f = 0 is the reference input, and, 

1 



<?(.) = 



(i) 



j 3 -f a 7 s 7 + ajs + «o 
where the coefficients a,- correspond to a stable polynomial. In state 6pace 
form, the system depicted in Figure 1 is written as, 



x 1 — x 7 , 
x 7 — X 3 , 

x 3 = —a 2 x 3 — QiX 2 — (a 0 -f K)x\ , 

where the state vector is, 



( 2 ) 

( 3 ) 

( 4 ) 



*i = y , = y , *3 = y 



( 5 ) 



Physically, we can think of this system as a representation of the funda- 
mental turning dynamics of a marine vehicle. In this context, x\ represents 
the vehicle’s lateral deviation from the commanded straight line path, x 2 is 
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Figure 1 : Ideal 3 rd-order regulator system 

the orientation angle, and x 3 the turning rate. To account for the geometric 
nonlinearities, the first state equation (2) is written as, 

*1 = Zj + , (6) 

where 7 < 0 for softening spring characteristics. To account for possible 
“over-steering” or “under-steering” effects, we modify the output of the 
block K of Figure 1 , to 

control effort = — Ky — K 3 y 3 , ( 7 ) 



instead of — Ky of the linear element. Therefore, the nonlinear system under 
consideration is, 



*1 ' 




0 


1 


0 




’ *1 




7*2 


x 7 


= 


0 


0 


1 




*2 


+ 


0 


. *3 . 




-(«o+/0 


-a 1 


-a 2 




. *3 . 
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C. OUTLINE OF ANALYSIS 



The following steps are performed in order to analyze system (8). First, 
application of Routh’s criterion yields the value of the gain margin, or the 
critical value of K for stability. Then we rewrite the system of equations in its 
normal coordinate form, and use the center manifold theorem to reduce the 
system into a two dimensional system. We apply the method of averaging 
to the reduced system, and finally, we introduce polar coordinates to the 
averaged system in order to reveal the existence of limit cycles. Development 
of these computations is the subject of the next chapter. 
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H. ANALYSIS 



A. LOSS OF STABILITY 

The characteristic equation of (8) is, 

s 3 + a 2 s 2 + <*!$ + (q 0 -f K) — 0 . (9) 

Application of Routh’s criterion to system (9) yields the critical value of K , 
iif c , for stability of Xi = x 2 = x 3 = 0, 

K c = QiQ 2 -«o . (10) 

If < K c the system is stable, whereas for K > K e it becomes unstable. 
The value of K Ci given in equation (10), expressed in decibels represents the 
gain margin of the system. 

At the critical point, K — oli(x 2 — ce©, the characteristic equation (9) is, 
s 8 + a 2 3 7 + c*i3 + aia 2 — 0 , 

which has roots, 

Sl = -y/a^i , 

3 2 = , (11) 

S3 = — • 

Therefore, we can see that the above loss of stability is characterized by the 
existence of a pair of purely imaginary roots. As K crosses If c , one pair of 
complex conjugate roots of (9) crosses transversally the imaginary axis. 
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A situation like this in which a certain parameter is varied such that 
the real part of one pair of complex conjugate eigen values of the linearized 
system matrix crosses zero, results in the system leaving its steady state 
in an oscillatory manner. This loss of stability is called Hopf bifurcation 
(Guckenheimer & Holmes, 1983) and generically occurs in one of two ways, 
supercritical or subcritical. In the supercritical case, stable limit cycles are 
generated after the nominal straight line motion loses its stability. The am- 
plitudes of these limit cycles are continuously increasing as the parameter 
distance from its critical value is increased. For small values of this critical- 
ity distance the resulting limit cycle is of small amplitude and differs little 
from the initial nominal state. In the subcritical case, however, stable limit 
cycles are generated before the nominal state loses its stability. Therefore, 
depending on the initial conditions it is possible to diverge away from the 
nominal straight line path and converge towards a limit cycle even before the 
nominal motion loses its stability. This means that in the subcritical Hopf 
bifurcation case the domain of attraction of the nominal state is decreasing 
and in fact it shrinks to zero as the critical point is approached. Random 
external disturbances of sufficient magnitude can throw the vehicle off to an 
oscillatory steady state even though the nominal state may still remain sta- 
ble. After the nominal state becomes unstable, a discontinuous increase in 
the magnitude of motions is observed as there exist no simple stable nearby 
attractors for the vehicle trajectory to converge to. Distinction between these 
two qualitatively different types of bifurcation is, therefore, essential in the 
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design of the autopilot. The computational procedure requires examination 
of the higher order terms in the equations of motion and it is the subject of 
the next section. 



B. COORDINATE TRANSFORMATIONS 



System (8) is written in the form, 

x = Ax + g(x) , 



( 12 ) 



where A is the linearized system matrix and g(x) contains the cubic terms. 
At the bifurcation point K — K c , matrix A has eigenvalues given by (11), 



and eigenvectors, 



T = 



‘0 1/v/oT 
1 0 
0 -y/o^ 




(13) 



By taking T to be the matrix of critical eigenvectors of A, the transformation, 



x = Tz , z = T -1 x , 



(14) 



transforms system (12) into its normal coordinate form, 



where, 



and, 



z = T- 1 ATz + T' 1 g(Tz), 



T" 1 = 



1 

ai -f a I 



OLi 0.2 Oi CKj 

y/o^o\ 0 -yf&\ , 

oi 0 1 



T _1 AT 



0 -^/c^ 0 

yfai 0 0 

0 0 -o 2 



(15) 



(16) 



(17) 
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For values of K dose to the bifurcation point K C1 the matrix T *AT 



becomes, 



T -1 AT 



a'e -( v /a7 + de) 0 
y/oc^ + w'e a!e 0 

0 0 — a 3 +p'e 



where e denotes the criticality difference, 



£ = K - K c , (19) 

and a' is the derivative of the real part of the critical eigenvalues with respect 
to e, is the derivative of the imaginary part of the critical eigenvalues with 
respect to e, and p/ is the derivative of the third eigenvalue s 3 with respect 
to e. These are computed using a perturbation series approach as follows. 
The characteristic equation (9) can be written in the form, 

s 3 + + ax s -f- + £) = 0 , (20) 



where we have used (10) and (19). The roots of (20) axe expressed as, 

Si = a e — + w' e) i , (21) 

32 — oc e + (v^7 d~ w ; e) i , (22) 

s 3 = —a 2 + p's . (23) 



If we substitute (21) through (23) in (20) and neglect terms of order e 2 , e 3 , 
we get, 



1 

2(ai + a 2 ) 

ot 2 

2 y /a^(a 1 +a\) * 
1 

a l + a 2 



(24) 

(25) 

(26) 
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C. REDUCTION OF ORDER 



The physical variables X{ axe related to the normal coordinates z* through 
(14), and using (13) we get, 

1 



X 1 — “7=^2 + <33 > 

vM 

x 2 = 2! — a 2 z 3 , 


(27) 


®3 = -y/aiz? + 0^23 . 





It can be seen from (26) that jJ < 0, and therefore the eigenvalue s 3 is 
locally (for e small) negative, as shown in equation (23). In fact, a quick 
root locus plot of (9) will show that s 3 is negative for all values of K > 
0. Therefore, the flow of (8) in the direction of 23 converges to zero. All 
interesting bifurcation phenomena axe locally restricted on a two dimensional 
manifold that decsribes the time evolution of the critical coordinates Z \ , z 2 ; 
this is the center manifold of (8). According to the center manifold theorem 
(Guckenheimer & Holmes, 1983), the stable coordinate 23 can be expressed 
as a function of the critical coordinates z 1} 23, and this relationship is at least 
of quadratic order. In fact due to the symmetry in our problem, the above 
relationship is of third order. Therefore, 23 does not affect the nonlinear 
terms in (15) and we can write (27) in the form, 



Xi 

*2 

®3 






( 28 ) 
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Using (28) we can write, 



g(Tz) = 



7 z i 



and, 



T -1 g(Tz) = 



1 



« 1 + 



. -k 3 4/*1 /2 . 

« i « 27 ^i — K 3 z^a 2 /a\ /2 

V^i a ll z i + K 3 4/ a i 

ai~izl - K z z$/a\ 12 



( 29 ) 



Using equations (18) and (29) we substitute in (15) and write the normal 
equations in Zi 9 z 2 as, 



ii = aezi — (y/ai + u;'e)z 2 + F 1 (z 1) z 2 ) , 
z 2 = {y/ai + w'e)zi + a'ez 2 + F 2 (z u z 2 ) , 



where, 



F \( z u z 2 ) = , 3 7*1 - 



«2 



a i + a 2 1 («i 4- af ) a i^ 2 






F 2 (zi,z 2 ) = V ^ a \ 7 z i + 7 1 2 ^ — • 

<*i+al (ai+a 2 )<*i 



(30) 

(31) 

(32) 

(33) 



Equations (30) and (31) describe the suspended center manifold flow of (15) 
(Guckenheimer & Holmes, 1983). 



D. AVERAGING 

If we introduce polar coordinates in the form, 

Zi = R cos 0 , Z 2 = R sin 6 , 



(34) 
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we can write equations (30), (31) as, 



R = aeR + Fi (R cos 0, R sin 9) cos 9 

+F 2 (R cos 9 , R sin 9) sin 9 , (35) 

R9 = (y/ai + w'e) R + F 2 (R cos 0,R sin 9) cos 9 

—Fi ( R cos 9 , i? sin 0) sin 9 . (36) 

Equation (35) is written in the form, 

R = a'eR + V(0)R 3 , (37) 



where the function V(9) is 27r-periodic in the angular coordinate 0, 



V{9) = cos 4 9 — cos 9 sin 3 fl 



a i + a 2 (ai + a£ )a^ 2 

a l +<*2 



+ 7— ^ 7 cos 3 9 an 9 + — — ^ - K 3 sin 4 fl . (38) 



<*i(ai + 0 %) 

If equation (37) is averaged over one cycle in 9 , we get an equation with 
constant coefficients, 

JR = aeR + QR* , (39) 



where 

Substituting (38) into (40) and evaluating the integral yields, 

3 a\a2't + A~3 

8 ai (a! + a|) 



(40) 



(41) 



Similar averaging can be performed for equation (36) which has the form, 



9 = y/aJ\ + id e + J~{9}R? , 



(42) 
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where -- 



_ ygTg| 

+ Cc\ 



T{9) = 2 2 7 cos 4 9 + 



<*i(<*i +0:2) 

a l a 2 3/, • /, , 

-7 cos 0 sin 6 + ■ 



K 3 cos 9 sin 3 9 



«2 



a l + a 2 ' a l /2 ( a l + a \) 

and we have assumed R ^ 0. The averaged form of (42) is, 



K 3 sin 4 9 , (43) 



9 = y/&\ + w t + QR 2 , 



(44) 



where 


s -hC^ dl - 


(45) 


and using (43), 


3a 2 aja 2 7 - K 3 
8 a? /2 (a! + a|) 


(46) 



The system of equations (39) and (44) exhibits similar stability properties 
to the original system (37) and (42) (Chow & Mallet-Paret, 1977), and is 
studied in the following section. 



E. LIMIT CYCLE ANALYSIS 

Equation (39) has two steady state solutions, one at R = 0 which corre- 
sponds to the trivial equilibrium solution at zero, and one at 

% = . (47) 

This equilibrium solution corresponds to a periodic solution or limit cycle 
in the cartesian coordinates Z \ , 2^ from (64). Since a ' as seen by (24) is 
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always, positive, existence of these periodic solutions depends on the value of 
Q . Specifically, 



• if Q < 0, periodic solutions exist for e > 0 or K > K c , and 



• if Q > 0, periodic solutions exist for e < 0 or K < K e . 



The Floquet exponent of (39) in the vicinity of (47) is 



P = -2 a'e , 



(48) 



and we can see that 

• if periodic solutions exist for K > K c they are stable, and 

• if periodic solutions exist for K < K c they are unstable. 

We refer to the first case as the supercritical Poincare-Andronov-Hopf (PAH) 
bifurcation and to the second case as the subcritical PAH bifurcation (Guck- 
enheimer & Holmes, 1983). 

The period of these limit cycles is computed by substituting (47) in (44), 




The amplitude of the limit cycles is computed from (47) and (28), and in 
terms of the physical variables xj, x 2 ? get, 




(50) 



2— Q i ( Q i a 2 - Op - K) 



3 ^ a? a 2 7 + K z 



(51) 
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x 3 



(52) 



\/3 / ^g; -gp - if 

3 V a?g 2 7 + i$T 3 ' 

We can see that in the supercritical case, on loss of stability of equilibrium 
the steady state becomes a periodic oscillatory state, the amplitude of the 
oscillation being proportional to the square root of the criticality e, the differ- 
ence of the gain K from its critical value K e at which stability of equilibrium 
is lost. This form of loss of stability is called “soft” loss of stability since 
the oscillating state for small e differs little from the equilibrium state. In 
the subcritical case, before the steady state loses stability the domain of 
attraction becomes very small as is bounded by the amplitudes of the un- 
stable limit cycles, and a random disturbance can throw the system off its 
equilibrium state even before its domain of attraction has completely disap- 
peared. This form of loss of stability is called “hard”. Here the system leaves 
its steady state with a jump to a different state of motion which can be a 
stable oscillation with a locally discontinuous increase in the amplitude, a 
more complicated bounded motion, or even an unbounded motion depending 
on other higher-than-third order terms that have not been incorporated in 
system (8). 
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m. RESULTS AND DISCUSSION 



A. RESULTS 

For demonstration purposes we assume that in the case K = 0 the system 
has been designed in accordance to the ITAE optimal criterion for third order 
systems; i.e., 

a 2 = 1.75c*; n 

«i = 2.15u,’ , (53) 

“o = <4 , 

where the natural frequency u> n is in general selected according to the desired 
bandwidth of the system. The ITAE criterion is a standard performance 
index and it minimizes the integral time absolute error J£° <|e(t)| dt, of the 
step response e(t) of a system (Dorf, 1992). This criterion is satisfied for 
a third order system when the coefficients of its characteristic equation axe 
selected as in equations (53). The critical value of K for stability is computed 

by, 

K e = ai« 2 - ao = 2.7625^ . (54) 

A graphical representation of equation (54) is shown in Figure 2 for a nominal 
range of u> n between 1 and 2 rad/sec. 

The cubic coefficient Q that dictates the nature (supercritical or subcrit- 
ical) and stability of the resulting limit cycles as K exceeds K e is given by 
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Wn 



Figure 2: Critical value K c versus u) n 




lln 



Figure 3: Cubic coefficient Q versus u>„ for = -5 and different values of 7 
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(41), and using (53) we get, 



<2 = 0.2707o>„ 7 + 0.0112^ . (55) 

A plot of equation (55) for K 3 = —5 and four different values of 7 is shown 
in Figure 3. 

Based on the results presented in Figure 3, the following observations can 
be made: ( 1 ) For fixed K 2 and a given value of w n , supercritical bifurca- 
tions are ensured for a value of 7 less than a critical threshold, computed by 
equating Q = 0. (2) In the case of supercritical bifurcations, we expect to see 
an oscillatory response approaching zero when K < K c and converging to a 
periodic solution for K > K c . The above response should be independent of 
the initial conditions, at least locally. (3) In the case of subcritical bifurca- 
tions, we expect to see an oscillatory response for K < K c which may or may 
not converge to zero. This depends on the initial conditions. If the response 
diverges from zero, the final attractor can be another oscillation or a more 
complicated motion. The same is true for K > K e , here the response should 
diverge regardless of the initial conditions. These conclusions are confirmed 
in the next section using direct numerical integrations of equations ( 8 ). 



B. NUMERICAL SIMULATIONS 

An example of supercritical behavior is shown in Figures 4 and 5. In both 
of these figures we present results based on direct numerical integrations of 
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equations (8) for the following conditions, 



= 2 , K = 1.05 K c , K 3 = - 5 , 7 = -0.1 . (56) 

For these conditions, which are selected to demonstrate the supercritical case, 
we can see from Figure 3 that Q < 0 and, therefore, we have a supercritical 
Hopf bifurcation. Figure 4 shows clearly the development of a stable periodic 
solution with amplitude x 2 = 0.68 and period T = 2.14. The theoretical 
value for the limit cycle amplitude is computed from (56) and (51), as x 2 = 
0.6405 which is in excellent agreement with the numerical value. Likewise, 
the period of oscillation is found from (56) and (49), as T = 2.1351 which is 
also close to the actual period. Figure 5 shows the convergence to the limit 
cycle in the (x 2l x 2 ) phase subspace using two sets of initial conditions. One 
set (x 1 ,x 2 ,x 3 ) = (0, 0.5,0) is located inside the limit cycle and the other set 
( xi,x 2 ,x 3 ) = (0,1,0) is located outside the limit cycle. It can be seen that 
both trajectories converge to the, numerically computed, periodic solution. 

An example of subcritical behavior for K > K c is shown in Figures 6 and 
7. In both of these figures the conditions were the same as (56) with the 
exception of 7 which was 7 = 0.2 for Figure 6 and 7 = 0.1 for Figure 7. 
These correspond to Q > 0 as can be seen from Figure 3, which confirms the 
subcritical behavior. The motion which corresponds to 7 = 0.2 is strongly 
subcritical and it becomes unbounded shortly after 20 seconds. The motion 
which corresponds to 7 = 0.1 is less subcritical since it yields a smaller, but 
still positive, value for Q. As seen in Figure 7, it appears that trajectories 
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t 



Figure 4: Time history (t,x 2 ) for w n = 2, I( = 1.05iif c , K 3 = -5, and 7 




xZ 



Figure 5: Phase subspace plot (^2,^2) for u>„ = 2, K = 1.05 K c , K 3 = -5, 7 
and two initial conditions 



19 




t 



Figure 6: Time history (t, x 2 ) for w n = 2, K = 1 . 05 iif c , K 3 = - 5 , and 7 = 0.2 
converge to a relaxation oscillation of high amplitude. 

An example of subcritical behavior for K < K c is shown in Figures 8 and 
9 , for the following conditions, 

u> n = 2 , K = 0 . 95 Ff c , K 3 = - 5 , 7 = 0.2 , ( 57 ) 

and different initial conditions in x 2 . For small initial conditions, (*1,125*3) = 
(0, 0.1,0), the system is located inside the unstable limit cycle and it con- 
verges to the stable equilibrium, as shown in Figure 8. However, for large 
initial conditions, (*i,*2,®3) = ( 0 , 0 . 5 , 0 ), the system trajectory is located 
outside the unstable limit cycle and it diverges away from the equilibrium, 
even though this equilibrium is still stable. It appears from Figure 9 that, for 
small 7, the system converges to a relaxation oscillation, while higher value 
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x2 



Figure 7: Phase subspace plot (x 2 ,i 2 ) for = 2, K = 1.05/if c , = —5, and 

7 = 0.1 

of 7 generate more severe subcritical behavior and the motion becomes un- 
bounded, as before. In the case of supercritical behavior and for K < K C1 
we observed that numerical integrations converged to the stable equilibrium 
regardless of the initial condition in x 2y as they should. 



C. MULTIPLE EQUILIBRIUM STATES 

So far, our analysis has been on stability properties of the trivial equilib- 
rium of ( 8 ), and its bifurcations to periodic solutions. It is possible, however, 
that additional equilibrium points may exist. To explore this, we write sys- 
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Figure 8: Time history (t,x 2 ) for v n = 2, K = 0.95 Ac, A' 3 = -5, 7 = 0.2, and 
x 2 {t = 0) = 0.1 




Figure 9: Time history (t y x 2 ) for w n = 2, K = 0.95 A' c , A 3 = —5, 7 = 0.2, and 
x 2 {t = 0) = 0.5 
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Figure 10: Steady state solutions X\ versus Kz for K = 0.95 life, 7 = 0, and three 
values of u> n 

tem ( 8 ) in the form, 

+ 7®2 > (58) 

^2 = ^ 3 , (59) 

x 3 = ~(a 0 + K)x i - a x x 2 - a 2 x 3 - I< 3 x\ . (60) 

In order to compute its equilibrium points we must set the time derivatives 
®i, * 2 ? ®3 zero, and solve for the equilibrium point X\ y X 2l X 3 . We examine 
the case 7 > 0 first. 

Equation (58) yields, 

X 2 + 7 X? = 0 , (61) 

which, since 7 > 0, has only one solution, namely X 2 = 0. Equation (59) 
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t 



Figure 11: Time history (t, *1) for a> n = 2, K = 0.95 K c , K 3 = —5, 7 = 0, and two 
initial conditions in x\ 

gives X 3 = 0, and then (60) can be solved for the remaining equilibrium 
solution Xi, 

X^ao + K + K 3 Xt) = 0. (62) 

Equation (62) admits the trivial solution, X\ = 0, always, and two more 
possible solutions provided K 3 < 0, given by, 

(63) 

Equation (63) yields two additional symmetrically located equilibrium points 
which are generated as K 3 becomes negative. A typical plot for K = 0.95 K c 
and three values of w n = 1, 1.5, 2 is presented in Figure 10. Therefore, we see 
that the same coefficient, K 3 , which governs the transition from subcritical 
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to supercritical bifurcations to periodic solutions of the trivial equilibrium 
state, is also associated with the existence of additional equilibrium states. 



In order to analyze the stability properties of these solutions we linearize 
equations (58) through (60) in the neighborhood of X*. If we denote by & the 
deviation of ® t - from equilibrium; i.e, 6 = we can write the linearized 

system as, 

6 = 6 , 

6 = 6 , (64) 

6 = -(ao + K)(, - ai ( 2 - a 2 ( 3 - 3K 3 Xth ■ 

If we substitute (63) in (64) we get, 

6 — 6 , 

6 = 6 , (65) 

$3 = 2(a 0 + K)£i — ai 6 — <*26 • 

The characteristic equation of (65) is, 

s 3 + ctzs 2 + ajs — 2 (qq + K) = 0 , ( 66 ) 

which means that the additional non-trivial equilibria are clearly unstable 
with divergent dynamics. Therefore, the case K 3 < 0 which was shown to 
be beneficial from the point of view of Hopf bifurcations, is undesirable from 
the point of view of static bifurcations. The final compromise depends of 
course on the particular demands and specifications of the design. Figure 11 
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Figure 12: Steady state solutions X\ versus K 3 for K = 0.95 K e , 7 = —0.1, u? n = 2, 
and X 2 7^ 0 

demonstrates the divergent properties of the additional equilibrium states 
for K 3 < 0. Two numerical simulations are shown for K 3 = —5, 

u> n = 2, and K = 0.95 K c , and for two sets of initial conditions, (*i,*2,*3) = 
(2.40,0,0) and (*i,*2,x 3 ) = (2.41,0,0). The unstable equilibrium Xi is 
located at 2.408 as predicted by (63). We can see that, as expected, numerical 
simulations inside the stable potential well, < X ly converge to zero while 
those outside, T\ > X\, diverge and quickly become unbounded. 

The case 7 < 0 can be analyzed similarly. Equation (61) admits in this 
case the trivial solution X 2 = 0 which was analyzed previously, and two more 
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Figure 13: Degree of stability of the lower outer solutions which appear in Figure 
12 




Figure 14: Trajectories for = —4.6 and two different initial conditions; variables 
correspond to Figure 12 
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Figure 15: Time history (t, ®i) for K$ = -3 and two initial conditions; variables 
correspond to Figure 12 




t 



Figure 16: Time history (t,*i) for c o n — 2 , K = 1.05A' C , K 3 = -5, 7 = —0.1, and 
two initial conditions in x\ 
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symmetrically located solutions, 



X\ = -1 . (67) 

Then X 3 = 0 while X 1 is obtained from (60) as the solution to, 

(qo “ 1" K)X\ + ol\X 2 + K$Xi = 0 . (68) 

A typical solution set of (68) is presented in Figure 12 for u> n = 2, K = 
0.95jFT c , and 7 = —0.1 with X 2 given from (67). If we compare this to the 
corresponding solutions for 7 = 0 shown in Figure 10 we can observe that 
the nontrivial solutions for 7 = 0 retain their shape, these are denoted by 
outer in Figure 12. The main difference here is the existence of two outer 
solutions for most of the range of K 3 . The trivial solution Xj = 0 of Figure 
10 perturbs in this case into the solution labeled as inner in Figure 12. It 
can also be observed that there is a point, in this case at about K 3 = —4.8 
where the lower outer solution coalesces with the inner solution. For values 
of K 3 less than this critical point only the upper outer solution remains. 

Stability properties of these solutions can be established by linearization. 
The linearized system of (58) through (60) for X 2 0 takes the form, 

6 = “26, 

6=6, (69) 

6 = — (o!o + K + 3K 3 X*)£i — 2 — <*26 • 

The characteristic equation of (69) is, 

s 3 + ol 2 s 2 -j- oils — 2 (q 0 “I - K + 3AT 3 AT 3 ) . (70) 
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Numerical computation of the roots of (70) revealed that both the inner solu- 
tion and the upper outer solutions were unstable. The lower inner solution is 
initially stable, in other words the point where the lower outer and the inner 
solutions of Figure 12 meet is a saddle-node point. The degree of stability 
of the lower outer solution, defined as the largest real part of the three roots 
of (70), is plotted in Figure 13 versus K$. This corresponds to a complex 
conjugate root. We can see that it is initially stable and that it undergoes a 
Hopf bifurcation at a value of K 3 approximately —4.15. 

These results are confirmed by the numerical integrations presented in 
Figures 14 through 16. For K 3 = —4.6, the lower outer equilibrium solution 
is stable. Therefore, the numerical simulations will converge to either this 
solution or the trivial equilibrium depending on the initial conditions, see 
Figure 14. The trivial equilibrium is a rather weak attractor in this case 
since K is very near its critical value K c . For K 3 = —3, the lower outer 
equilibrium point has become unstable and is surrounded by a stable limit 
cycle. Depending on the initial conditions, trajectories will converge to either 
the stable trivial equilibrium or one of the two stable limit cycles, see Figure 
15. Apparently there exists a region where the final outcome is sensitive 
to the choice of initial conditions, and the corresponding transient response 
resembles a random pre-chaotic motion before the trajectories converge to 
the corresponding attractor. This limit cycle persists as K exceeds K c , see 
Figure 16. In this case the trajectories will converge to either the trivial or 
the non-trivial limit cycles, depending again on the initial conditions. 
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IV. CONCLUSIONS AND RECOMMENDATIONS 



This work presented a methodology for assessing the dynamic response of 
a third order system with respect to changes in its gain. Choice for the 
baseline system was motivated by modeling the fundamental dynamics of an 
autonomous vehicle. The methods, however, axe of general nature and can 
be applied to any given system. An extensive study of the dynamic loss of 
stability was performed based on Hopf bifurcation theory techniques. The 
existence of both subcritical and supercritical bifurcations to periodic solu- 
tions was established depending on the system parameters. It was shown that 
the critical system gain for stability is useful for design purposes only to the 
extent that it is accompanied by supercritical bifurcations. The latter can be 
studied using a comprehensive nonlinear study like the one presented in this 
work. Future work should concentrate on classifying the nonlinear dynamics 
of various dynamical systems in terms of their order and linear/nonlinear 
properties. Such a generalization could allow the establishment of a more 
reliable set of measures than the linear gain margin, which would be used in 
control system design. 
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